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Abstract. - Slow- wave sleep in mammalians is characterized by a change of large-scale cortical 
activity currently paraphrased as cortical Up/Down states. A recent experiment demonstrated 
a bistable collective behaviour in ferret slices, with the remarkable property that the Up states 
can be switched on and off with pulses, or excitations, of same polarity; whereby the effect of 
the second pulse significantly depends on the time interval between the pulses. Here we present 
a simple time discrete model of a neural network that exhibits this type of behaviour, as well as 
quantitatively reproduces the time-dependence found in the experiments. 
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O Introduction. — Collective oscillations in networks 
composed of coupled elements have continuously attracted 
<-H great interest regardless of the scientific field [IHS] ■ In 
neural systems, oscillations have been studied both exper- 
imentally and theoretically for decades [HIE] but a concise 
| understanding of the neural dynamics still remains a con- 
tinuous challenge. 

| A remarkable change of its oscillatory behaviour is dis- 
played by the mammalian brain at the onset of sleep. The 

(^frequency of collective cortical activity, as measured by 
scalp electroencephalography (EEG), drastically decays 
during sleep onset. With further deepening of sleep a sig- 

V nificant increase of power in the lower frequency bands 

rS delta (1-4 Hz) and theta (4-8 Hz) is observed [8]. 
03 In contrast to these clearly observed differences between 
sleep and wake EEG, only hypotheses for the role of these 
dynamical changes exist. During slow wave sleep, a sleep 
stage named after its oscillations in the 1 Hz region and 
below, cortical regions largely undergo alternations be- 
tween states of high activity by synchronous firing (Up 
states) and stages of relatively long quiescence (Down 
states) [9,10 . These slow oscillations manifest an inter- 
esting phenomenon on its own, e.g. by forming travelling 
waves [TThT3] . 

Recent studies have shown that slow oscillations dur- 
ing sleep may possess a promoting role in neural plasticity 
and learning, e.g. an enhancement of the consolidation of 
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new memories |14j . For instance, improvement of declara- 
tive memory performance was observed after transcranial 
stimulation during sleep |15j . A natural extension of this 
finding is to investigate the manipulation of slow oscilla- 
tions by external stimulation [15H17J . This could provide 
an access route to influence or even control the sleep state 
itself, as slow waves not only were observed experimen- 
tally to group so-called spindle oscillations [TU], but dy- 
namically have the potential to entrain thalamic networks 
into collective sleep spindle oscillations [IB] ■ On the other 
hand, manipulation of slow oscillations exhibits a starting 
point to advance the transition of different sleep stages 
and in the long term even to facilitate the onset of sleep. 

In recent in vitro experiments on prefrontal and occipi- 
tal cortex slices of ferrets, Shu et al. Q15] demonstrated a 
neural system showing collective oscillations that can be 
forced into an Up state by injecting a positive electrical 
pulse. This state could afterwards be terminated by a 
second pulse of identical polarity, but with a specific de- 
pendency on pulse intensity and delay to the first one [191 
fig. la,b]. This type of response on such a stimulation 
protocol offers a very intriguing way to control neural sys- 
tems. In this paper we specifically aim to reproduce and 
explain the experimental results of Shu et al. by a simple 
but sufficiently accurate model. 

The paper is organized as follows. First we introduce 
our model, where we demonstrate the mechanism underly- 
ing its basic behaviour by means of a single neuron. On the 
basis of this model we explain the experimental results of 
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[19] by applying their stimulation protocol and reproduce 
the central response diagram relating interstimulus inter- 
val and Up state duration. We continue with an examina- 
tion of the dynamics and properties of a noisy network and 
in particular focus on the importance of coupling. Finally, 
we provide a mean field analysis of the network to investi- 
gate its stability properties, after which we conclude with 
a brief summary and outlook. 

The model. — Our model is based on the central hy- 
pothesis that slow oscillations are caused by an interplay 
between recurrent excitation and an inhibition controlled 
by slow adaptive currents, in particular a Na + dependent 
K + current |20ll2"T] . The qualitative sketch of the dynam- 
ics is as follows: During the inactive state, neurons receive 
synaptic input from ongoing spontaneous activity, which 
occasionally excites enough postsynaptic neurons and re- 
sults in synchronous firing of greater regimes of cells, form- 
ing the beginning of an Up state. This state is then main- 
tained by the recurrent excitation between all participat- 
ing cells. During the burst state, inhibitory currents build 
up and slowly decrease the neuronal excitability, eventu- 
ally commencing the inactive phase. As the majority of 
neurons is in their ground state, the adaptive currents re- 
cover from the integration back to their initial point, and 
finally allow the cycle to start again. 

We introduce our model by looking at a single neuron. 
As the focus lies on the dynamics of the network and, 
above all, on the slow oscillations that operate on a much 
larger time scale then a single spike, we restrict our study 
to an integrate and fire model with McCulloch & Pitts 
neurons [221 . i.e. the neuron is reduced to two states, 
being either active or in its ground state, corresponding 
to the values 1 and 0, respectively. The activity of this 
binary neuron is modelled by a Heaviside step function 0, 
eq. (TTa|) . Consequently, we also neglect the dead-time of 
a neuron after a spike is produced. The complete model 
is then defined by a time-discrete map consisting of the 
following equations: 

x t+1 =Q[I-d f -'d t ] (la) 
=\^ t + gx t (lb) 
=A*0* + hB[fi t -d b ] . (lc) 

By construction, each neuron receives the same input /, 
which we assume to be a constant driving force, in order 
to explain the dynamics of our model. If we first consider 
the input / to be slightly larger than both negative terms 
df and i? , where df is the constant firing threshold and 
becomes adaptive in combination with the argument 
of the Heaviside step function is positive and hence the 
neuron is active, i.e. x = 1. 

Besides a leakage term in eq. (jlbl) the variable n holds a 
dependence on the activity of the neuron. Whenever the 
neuron is active, i.e. equal to 1, /x is increased by the value 
g. An Up state of prolonged neuronal firing thus results 
in a steady raise of fi. This integration process eventually 
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Fig. 1: Dynamics of a single neuron over 250 time steps. 
The neuron activity oscillates between an active and quiescent 
phase (top), /i is responsible for the duration of an Up state, 
by reaching db = 0.98 it triggers the inhibition and induces 
a Down state. Hence the interval of inactivity is determined 
by the decay of #. The remaining parameters are as follows: 
I = 0.25, d f = 0.2, A M = 0.9, A* = 0.95, g = 0.1 and h = l. 

activates the second Heaviside step function in eq. (Tic)) 
when the value of \x exceeds the burst threshold db- 

By triggering the second Heaviside function, & is im- 
mediately increased by h which also effects the adaptive 
threshold. As this threshold is now larger than input I 
the argument of the Heaviside step function in eq. (jlal) is 
no longer positive and the neuron is forced into its ground 
state, i.e. a transition from an Up to a Down state occurs. 

During this time of quiescence •& decays due to its leak- 
age term. If this decay has progressed far enough, the 
input / is eventually larger then the sum of db and 
and the neuron moves into the Up state again, starting a 
new cycle. Fig. Q] shows these dynamics for a few cycles. 
We can clearly distinguish the integration, inhibition and 
recovery processes responsible for the generation of slow 
oscillations as proposed by [2U]. In a subsequent section 
we will present some analytical mean field calculations of 
the model, where we will have a more detailed look on the 
existing fixed points and their stability. 

The great advantage, besides the small computational 
requirements to evaluate discrete maps, is that a neuron 
consists of only three equations, making it very easy to 
perform simulations. To be more specific, throughout the 
paper we will choose the parameters in such a way, that 
Up and Down states last about 50 time steps. The model 
parameters for the noisy network, see beneath, are, unless 
mentioned otherwise: df = 0.2, db — 0.98, a = 0.2, (7=1, 
A M = 0.9, A,? = 0.96, g = 0.1 and h = 2. 

Influence of external stimuli. — Using this simple 
model as a basis we can give an explanation to the ex- 
perimental results from Shu et al., i.e. the dependence of 
an Up state termination on the stimulus intensity and the 
interstimulus interval. The central role of the underlying 
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Time steps 

Fig. 2: (Colour online) External stimuli moves neuron towards 
inhibition threshold. The effect of an external stimulus depends 
on the progress of n's integration process, i.e. how close /i is to 
the inhibition threshold db (red dashed line). Early injection of 
a weak pulse (magenta) will not terminate an Up state, unless 
the delay to the onset is larger (blue). Consequently pulses of 
high intensities are more likely to push fx above db (green). 



mechanism is played by the variable \i. Its dynamics re- 
flect the build-up of inhibitory currents during an Up state 
as proposed by Sanchez- Vives and triggers the transition 
to a Down phase. 

The external stimulus basically moves the variable \x 
closer to the inhibition threshold db- Fig. [5] demonstrates 
this issue. Regarding the time dependence we can see that 
an early applied weak pulse will not be able to terminate 
an Up state, it will rather shorten the Up state duration 
by increasing \x. But if the pulse injection after the onset 
of a burst is delayed, the steady increase of /i by the inte- 
gration process has progressed far enough, such that the 
weak pulse is eventually strong enough to push fi above 
db and trigger the inhibition mechanism by On the 
other hand it is obvious that with increasing pulse inten- 
sity the minimal delay necessary to terminate an Up state 
decays, until it is completely negligible for strong intensi- 
ties, which explains the second dependency found in the 
experiment. 

The application of the same stimulation protocol from 
|19j . i.e. different combinations of intensity and delay, on 
our model is summarized in fig. [31 It is clear that our 
results give a very satisfactory qualitative reproduction of 
the experimental results. 

A noisy network. — Next we investigated an exten- 
sion of our model to a network of N — 10 000 neurons, 
where we only consider an excitatory all-to-all coupling 
among the neurons. Despite the fact that experimental as 
well as theoretical findings hint towards a balance between 
excitation and inhibition to sustain Up states in cortical 
networks [231124) . inhibitory synaptic connection were ne- 
glected as excitatory interaction between the neurons on 
its own is sufficient for our investigations. 

To construct the network out of eqs. (|lalllc[) . we re- 
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Fig. 3: (Colour online) Up state duration vs. double pulse 
interstimulus interval. The results of a double stimulation with 
different intensities and interstimulus intervals show the same 
qualitative dependencies as found in the experiment by [19] . 
i.e. with increasing intensity the need of a delay vanishes. The 
different colours indicate different intensities. 



moved the constant driving force / and replaced it by a 
sum over all neurons in the network multiplied it by a 
normalized coupling strength C and furthermore added a 
local Gaussian noise term £ with zero mean and intensity 
(or variance) a due to the fact that every neuron in general 
receives input from multiple sources of noise, e.g. synap- 
tic noise and channel noise [25] . The modified system of 
equations reads: 



= 8 



N 



,t+i 



3 = 1 
.* i t 



(2a) 

(2b) 
(2c) 



Taking the Gaussian noise fluctuations into account, all 
following simulation results were averaged over 1000 real- 
izations. 

The first question to clarify is whether the network can 
generate slow oscillations. If we set the coupling C = 
and do not consider any external manipulation, the Gaus- 
sian noise £ replaces the constant input I from the previ- 
ous section and acts as an intrinsic driving force. Setting 
the variance a close to the firing threshold df ensures a 
repetitive activation of the neurons. Due to noise fluctu- 
ations the probability of synchronous firing, which in this 
case means that more than 75% of the population are si- 
multaneously active, of a large neural population is very 
small. As is the case that the inhibition mechanism is 
activated through continuous firing of the neuron. This 
demonstrates the necessity of an interaction between neu- 
rons. 

By increasing the coupling strength C we enable an ex- 
citation of other neurons that leads to synchronous fir- 
ing. More importantly, sufficient coupling strength can 
compensate for the noise fluctuations and the high activ- 
ity within the network will be sustained. That is, this 
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Fig. 4: Role of coupling within the noisy network (a = 0.1). 
The noise driven network needs excitatory connections between 
neurons with a certain strength to generate slow oscillations. 
Black circles indicate external pulse injections. 

sketched process corresponds to an Up state onset. Al- 
though the model is quite simple and neglects the spiking 
property of single neurons, the need of excitatory con- 
nections between neurons qualitatively resembles the re- 
current excitation mentioned above, which is responsible 
for maintaining the Up state. Persistant firing of a single 
neuron also causes a steady increase of \i that eventually 
triggers the knockout through #, resulting in a stable al- 
ternation between Up and Down phase. 

A far more interesting question to address is to what ex- 
tent it is possible to self-generate and to induce Up states 
in our network. Beginning with a high coupling strength 
and slowly decreasing it, the ability to self-generate slow 
oscillations is lost after passing a critical point. The net- 
work shows activity but homogeneously distributed and 
not grouped together. But for a certain range it is still 
possible to induce a complete Up state just by applying a 
single pulse as fig. 2] shows. We only studied the stimula- 
tion of all neurons, but depending on the present coupling 
it is possible to apply the pulse only on a subpopulation. 

From the left part of fig. 2] we can conclude another 
important aspect, namely that in this range of coupling 
strength, there is no dependence on the pulse intensity. In- 
jecting a higher intensity on all neurons would only result 
in a very short excitation of the neurons, as the coupling 
strength is too weak to maintain an Up state. 

Further reduction of C finally yields a state where, only 
due to sufficient noise intensity, the network is again active 
with a low amplitude homogeneously distributed over the 
neurons. Fig.[S]shows a phase portrait of these three states 
that have just been outlined. There is in fact a fourth 
phase, in which the network shows no activity at all, but 
that does not play an important role, as the brain itself 
does not show a state of complete inactivity and we just 
mention it for the sake of completeness. 

As we have already emphasized the necessity of an ex- 
citatory coupling, we would like to point out the relation 
between synaptic coupling and sleep. We have discussed 
the different phases of the network with respect to the cou- 
pling strength. These findings coincide with the hypothe- 
sis of Tononi that sleep is caused by an increase of synaptic 
strength during wakefulness [55]. On the other hand, the 
existence of a state that shows slow oscillations when ex- 
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Fig. 5: (Colour online) Phase portrait of noisy network. Vari- 
ation of coupling strength and noise intensity (i.e. variance a) 
reveals three firing states of the network. Besides the phase 
in which Up states formed of at least 75% active neurons of 
the network population are intrinsically generated (red), the 
other two represent phases where Up states may be induced 
by an external (periodic) signal or the networks shows random 
distributed activity with no Up states. 



ternally stimulated and otherwise does not, reflects the 
intuitive aspect that a tired subject with increased synap- 
tic connections might react more sensitive on a periodic 
(sensory) stimulation and promotes a movement towards 
a deeper sleep stage. 

Mean field. — In order to understand the dynamics 
of the presented model we construct a mean field model 
from the time discrete system and study its fixed points 
and stability. For reasons of easier handling the eqs. (|2at - 
l2c| have to be slightly modified first. The currently local 
inhibition is replaced by a global mechanism, i.e. the vari- 
ables /i and d will depend on the whole populations of 
neurons, therefore they both loose their index and x\ in 
the integration term of cq. (|2bp is substituted by the aver- 
age network activity = (1/-/V) J2i x \- This modification 
obviously represents a severe abstraction of the underlying 
mechanism within the network, in particular with respect 
to the adaptive inhibitory currents assumed for each sin- 
gle neuron. However experimental findings reveal a strong 
synchrony of neurons during slow oscillation that range 
over large cortical areas [27], i-e. for our case we assume 
such a high degree of synchrony among the neurons. 

With these modifications we may rewrite the Heaviside 
step functions in terms of a probability, to what extent 
the element x is active as a sigmoid function [28) 



x'+'^l + e^H)) 1 (3 ) 

where /3 (reminiscent of an inverse temperature) is related 
to the variance a of the Gaussian noise £ by /3 = 1/ V2a 2 . 



p-4 



Triggering up states in all-to-all coupled neurons 



epl Europhysics Letters, in print (2010) 











J 


j discrete — 
| mean field — 


f 





























100 



200 
Time steps 



Fig. 6: Comparison between the time-discrete system (solid 
line) and the mean field model (dashed). 
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Fig. 7: (Colour online) Fixed points according to eq. (|6a|l for 
a firing threshold ranging between and 1. The stability is 
denoted by different colours: Green for stable and red for un- 
stable fixed points. One can clearly identify an area of bistabil- 
ity where two stable fixed points, corresponding to ground and 
firing state, with an unstable fixed point in-between, coexist. 



The changes yield the following mean field model 

x t+1 = (l + e-^ Cxt - d '-^y 1 (4a) 
S+^X^S + gx* (4b) 
0*+* = A,? 0* + h (l + e-^-^ ~ . (4c) 

To legitimate the mean field model, fig. \6\ shows a com- 
parison between the time discrete system with global inhi- 
bition and the mean field model. One can see clearly that 
both models yield the same behaviour, the discrepancy at 
the increase of is due to the second sigmoid function in 
eq. (|4c|) that introduces a smoother transition. 

If a fixed point (x*,fi*,i3*) is present, eqs. (|4b|) and (|4"c)) 
can be transformed into 

0' = — i— (l + e- 8 '""-*) - )" 1 , (5b) 
1 — Atf V / 

which, after insertion into eq. (|4al) . leads to the (implicit) 
fixed point equation of the mean field model 



with 

(<i<:) 

Eq. (|6a[) provides the number and positions of all exist- 
ing fixed points. The stability of the fixed points then 
follows from a linear stability analysis, where the same 
parameters as in the previous section were used, except 
g = 0.05, (3 = 30 and C = 1. The adjustment of g had 



to be performed as the mean field transformation with its 
two sigmoid functions causes a shift in parameter space. 

The dynamics of the fixed points are best demonstrated 
by varying the firing threshold df over a range from to 
1, by which we can identify three areas of stability within 
the model, as shown in fig. [7] 

For df < 0.167 eq. (pa)) yields one fixed point, which is 
stable as the absolute values of all eigenvalues are smaller 
than 1. The firing threshold in this range is too low so 
that the neurons are always able to overcome df and fire, 
which also explains the fixed point value of about 1. 

At df « 0.165, a critical fixed point at x = 0.04 emerges 
that commences a saddle node bifurcation, as with in- 
creasing df this critical fixed point separates into two fixed 
points, of which one is stable and the other unstable. From 
that point on the system possesses in total two stable fixed 
points with one unstable in between, i.e. the system is 
bistable and either converges into the ground or firing state 
or, if externally stimulated, allows for switching between 
both. 

For df as 0.835 another saddle node bifurcation occurs, 
but this time the unstable and the upper fixed points 
merge and vanish, leaving only the lower fixed point x = 0. 
This transition corresponds to the moment when the firing 
threshold is too high for the neuron to overcome and it is 
bound to stay in the ground state. 

Conclusion. — We presented a simple model on a ba- 
sis of a time-discrete map that generates slow oscillations. 
The transition from an Up to a Down state is modelled re- 
ferring to an integration and inhibition process via adap- 
tive inhibitory currents proposed by Sanchez- Vives [20] ■ 
An investigation of an all-to-all coupled network demon- 
strated above all the need of excitatory connections be- 
tween neurons in order to trigger and maintain Up states. 

Here we have shown that our model reproduces the ex- 
perimental results from Shu et al. [TH] , with respect to the 
on/off switching of network activity by external pulses of 
same polarity on a satisfactory qualitative level and ex- 
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plains them via a simple mechanism. The network pos- 
sesses different states of activity: Two states where Up 
states are either caused by internal noise and coupling or 
induced through external stimulation and a third, where 
they are completely absent and the network shows homo- 
geneously distributed random activity. 

We conclude from our model that the coupling strength 
is an essential control parameter. This is roughly consis- 
tent with the hypothesis that sensory stimulation during 
the day strengthens synaptic connections and promotes 
the slow wave activity during deep sleep. 

Regarding the phase portrait in fig. \5\it seems obvious 
that another way to induce a phase transitions in our net- 
work can be realized by varying the noise intensity, i.e. 
a horizontal movement in the phase plane. If the blue 
"active, no Up states" phase is then labeled as the wak- 
ing state, the disappearance of slow oscillations follows 
from an increased noise input. With this approach our 
model could explain brief sleep-wake transitions as they 
have been investigated by Lo et al. [29 , 30 , who mod- 
elled complex interactions between sleep active and wake- 
promoting neurons by a random walk. Hence it would be 
worthwhile to investigate the effect of a fluctuating noise 
intensity close to such a phase transition. 

It is undeniable that the model we presented here is a 
very minimal model, capturing the essential mechanisms 
only and allows for further extensions. We have only stud- 
ied the consequences of next neighbour coupling briefly, 
where results were qualitatively the same. Also delay and 
refractory effects, which become relevant on time scales 
close to a single spike, were neglected as slow oscillations 
operate on a coarser time resolution and thus made those 
properties irrelevant for the modelling. In a similar way 
synaptic plasticity on shorter time scale may effect the dy- 
namics as well; here there was no need to rely on plasticity 
in order to demonstrate the basic effects. 

An interesting perspective would be to apply control 
and influence the dynamics. An essential part of the dy- 
namical mechanism are the two global inhibitory degrees 
of freedom per neuron. Any means of control of the sys- 
tem is most effectively applied by taking into account the 
previous state of the system, which in our model would be 
the state of the two slow adaptive variables fi and 1?. This 
supports the hope that predictive, previous state-based or 
anticipatory chaos control techniques 31-35 could be ap- 
plied to influence the cortical Up and Down dynamics that 
manifest slow wave sleep. 
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